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1. Introduction and Primal Problem 

Minimal distance problems between two surfaces arise naturally from many ap- 
plications, which have been recently studied by both engineers and scientists (see 
[13, 15]). In this article, the problem presents a quadratic minimization problem 
with equality constraints: we let x := (y, z) and 

{V) : min |n(x) = ^||y - zf : h{y) = 0, g{z) = o| , (1) 
where h : M" —?■ M and g : JR" — > M are defined by 

My):=^(y*Ay-r2), (2) 

<7(z):=iaQ||z-c|p-^y-f*(z-c), (3) 

in which, A G iR"'^" is a positive definite matrix, a,r and rj are positive numbers, 
and f , c € iR" are properly chosen so that these two surfaces 

3^e:={yGiR": h{y)=0} 

and 

Z, := {z £ IW" : giz) = 0} 
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are disjoint such that if z G then h{z) > 0. For example, it can be proved that if 
c = 0, r > 0, 77 > O.Sr^ and ||f|| < 0.5{0.5r'^ - r]f /r then, ycnZc = $ and if z G 
then h{z) > 0. Notice that the feasible set -Yc = x -^c C iR" x iR", defined by 

= {x G iR" X iR" : h{y) = 0, g{z) = 0}, 

is, in general, non-convex. 

By introducing Lagrange multipliers A, /i G M to relax the two equality con- 
straints in Xc, the classical Lagrangian associated with the constrained problem 
(V) is 

L(x, A, /x) = ^ ||y - zf + A/i(y) + //^(z). (4) 

Due to the non-convexity of the constraint g, the problem may have multiple 
local minima. The identification of the global minimizer has been a fundamentally 
difficult task in global optimization. The canonical duality theory is a newly devel- 
oped, potentially useful methodology, which is composed mainly of (i) a canonical 
dual transformation, (ii) a complementary- dual principle, and (iii) an associated 
triality theory. The canonical dual transformation can be used to formulate dual 
problems without duality gap; the complementary-dual principle shows that the 
canonical dual problem is equivalent to the primal problem in the sense that they 
have the same set of KKT points; while the triality theory can be used to iden- 
tify both global and local extrema. In global optimization, the canonical duality 
theory has been successfully used for solving many non-convex/non-smooth con- 
strained optimization problems, including polynomial minimization [3, 6], concave 
minimization with inequality constraints [5], nonlinear dynamical systems [17], non- 
convex quadratic minimization with spherical [4], box [7], and integer constraints 
[!]• 

In the next section, we will show how to correctly use the canonical dual trans- 
formation to convert the non-convex constrained problem into a canonical dual 
problem. The global optimality condition is proposed in Section 2. Applications 
arc illustrated in Section 3. The global minimizer is uniquely identified by the 
triality theory proposed in [2]. 



2. Canonical dual problem 

In order to use the canonical dual transformation method, the key step is to intro- 
duce a so-called geometrical operator ^ = A(z) and a canonical function V{^) such 
that the non-convex function 



W{z) = 




in g(z) can be written in the so-called canonical form VF(z) = V{A{z)). By the 
definition introduced in [2], a differentiable function V : Va C M ^ Va* C JR 
is called a canonical function if the duality relation <^ = DV{$,) : Va — >■ Vq* is 
invertible. Thus, for the non-convex function defined by (5), we let 



C = A(z) = 
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then the quadratic function V{^) := — r])^ is a canonical function on the 

domain Va = £ -K : C ^ 0} since the duahty relation 

is invertible. By the Legendre transformation, the conjugate function of V^(^) can 
be uniquely defined by 

^* w = {^^ - v{o ■■ ^ = Dv{0} = + (6) 

It is easy to prove that the following canonical relations 

^ = DV*{c;) ^ , = DV{0 ^ V{0 + V*{,) = (7) 

hold in Va x Va* ■ Thus, replacing W{z) in the non-convex function g(z) by 
y(A(z)) = A(z)? — V^*(?), the non-convex Lagrangian L(x,X,iJ,) can be written 
in the Gao-Strang total complementary function form 

S(x, A, /X, ^) = ^ ||y - zf + Xhiy) + /x(A(z)^ - V*{<;) - f*(z - c)). (8) 

Through this total complementary function, the canonical dual function can be 
defined by 

n<^(A, /X, = {S(x, A, ^^, : VxS(x, A, /x, = 0}. (9) 

Let the dual feasible space Sa be defined by 

Sa := {(A, 11, q) eM^ -.{1 + /x<j)(I + AA) - I is invertible}, (10) 

where I G iR"^" is the identity matrix. Then the canonical dual function 11'^ is well 
defined by (9). In order to have the explicit form of 11'^, we need to calculate 



y - z + AAy 
z - y + //?(z - c) - ni 



VxS(x, A, <?) 

Clearly, if (A, /x, q) G Sa we have that Vx2(x, A, iJ.,q) =0 if and only if 
x{X,H,q) 



A/((l + /iO(I + AA)-I)-i(f + 
m(I + AA)((1 + + AA) - I)-i(f + ?c) 



(11) 



Therefore, 

n'^(A, ?) = H(x(A, 12, ?), A, /X, ?), 
where x(A, /Lt,^ is given by (11). 

The stationary points of the function H play a key role in identifying the global 
minimizer of {V). Because of this, let us put in evidence what conditions the sta- 
tionary points of S must satisfy: 
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VxS(x, A,/x,^) 

dE 



y - z + AAy 
z - y + /^^(z - c) - /if 



dX 
dE 
djjL 
dE 



0, (12) 

(x,A,Ai,O = ^(y)=0, (13) 

(x, A, II, = A(z)^ - V*{^) - f*(z - c), (14) 

(x,A,M,?) =MA(z)- W*(?)). (15) 



The following result can be found in [19]. Their proof will be presented for com- 
pleteness. 

Lemma 2.1: Consider (x, A, /x,^^) a stationary point ofE then the following are 

equivalent: 

a) IJ, = 0, 

b) X = 0, 

c) Xc- 

Proof : 

a) ^ b) If /Lt = 0, then from (12) we have y = z. This implies that AAy = but 

y 7^ since ||y|| = r by (13) and A is invertible, therefore A = 0. 

b) — ^ c) If A = 0, then from (12), y = z and so (y, z) ^ Xc because Zc = 0. 

c) — ^ a) Consider the counter-positive form of this statement, namely, if / then 

from (15), A(z) = DV*{^) which combined together with (7) and (14) 
provides z G Zc- Since y G from (13), it has been proven that x G Xc- 

□ 

Now we are ready to re-introduce Theorems 1 and 2 of Gao and Yang ([9]). 

Theorem 2.2: (Complementary-dual principle) If (x, A,/x,?) is a stationary 
point of E such that (A, ft, ?) G 5a then 5t is a critical point of {V) with A and 
p, its Lagrange multipliers, {X,jl,^) is a stationary point ofH'^ and 

n(x) = L(x, A, /Z) = S(x, A, A, ?) = n«'(A, /X, C). (16) 

Proof: Prom Lemma 2.1, we must have that A and jl are different than zero, 
otherwise they both will be zero and (0, 0, ^ Sa for any <j G K which contradicts 
the assumption that (A, fl, ^) G Sa- Furthermore x G Xc, clearly x is a critical point 
of (V) with A and jl its Lagrange multipliers and 

n(x) = L(x, A, p,) = S(x, A, p,, 

On the other hand, since (X,p,q) G Sa, Equations (11) and (12) are equivalent, 
therefore it is easily proven that 

dE _ - _ _ dW^ - _ _ 

— (x,A,/i,0 = -^(A,/i,^) = 0, 

where t is either A, or This implies that (A, p, ?) is a stationary point of II'^ and 



S(x,A,/x,0 = n<^(A,/x,0 
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The proof is complete. □ 

Following the canonical duality theory, in order to identify the global minimizer 
of (V), we first need to look at the Hessian of S: 



VxH(x, A, 



I + AA -I 
-I + 



(17) 



This matrix is positive definite if and only if I + A A and (1 + + A A) — I 

are positive definite (see Theorem 7.7.6 in [12]). With this, we define C Sa as 
follows: 

5+ := {(A, //, ?) G 5„ : I + AA ^ and (1 + //?)(! + AA) - I ^ 0}. (18) 

Theorem 2.3 : Suppose that (A,/i, C) € 5+ is a stationary point ofH'^. Then x 
defined by (11) is the only global minimizer o/II on Xc- 

Proof : Since (A, q) G 5^, it is clear that x £ Xc and is the only global minimizer 
of S(-,A,/i, ?). From (7), notice that F is a strictly convex function, therefore 
F*(0 = sup{^c - ViO : e > 0} and 

S(x, A, jl, C) < L{x, A, /i), Vx G iR"><", (19) 

in particular, H(x, A, fi, ^) = -L(x, A, fl). Suppose now that there exists x' G Afg \ {x} 
such that 

n(x') < n(x), 

we would have the following: 

L(x', A, /x) = n(x') < n(x) = L(x, A, p.), 

but because of (19) this is equivalent to 

S(x', A, jl, C) < -L(x', A, p,) < L(x, A, p,) = E{5c, A, p, C). 

This contradicts the fact that x is the only global minimizer ofS(-,A,/i,^), there- 
fore, we must have that 

n(x) < n(x), VxG A'c\{x}. 

□ 

Remark 1 : Notice that Theorem 2.3 cnsTircs that a stationary point in will 
give us the only solution of {V). Therefore, the existence and uniqueness of the 
solution of {V) is necessary in order to find a stationary point of 11'^ in S^. From 
this it should be evident that the examples provided in [19] does not contradict 
any of the results established under the new conditions of Theorems 2.2 and 2.3. 
It is a conjecture proposed in [7] that in nonconvex optimization with box/integer 
constraints, if the canonical dual problem does not have a critical point in S^, the 
primal problem could be NP-hard. 
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3. Numerical Results 

The graphs in this section were obtained using WINPLOT [14]. 

3.1. Distance between a sphere and a non-convex polynomial 

Let n = 3, ry = 2, a = 1, f = (2, 1, 1), c = (4, 5, 0), r = 2^2 and A = I. In this 
case, the sets Sa and 5+ are given by: 

Sa = {(A, fl, G iR3 . (1 + ^0(1 + \)^ 1}, (20) 

5+ = {(A,^,?) G -K^ : 1 + A > 0, (1 + ^?)(1 + A) > 1}. (21) 
Using Maxima [16], we can find the following stationary point of H'^ in S^: 

(A,//,^) = (0.9502828628898,1.06207786194864,0.30646555192966). 
Then the global minimizer of {V) is given by Equation (11): 




Figure 1.: Distance between a sphere and a non-convex polynomial 
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3.2. Distance between an ellipsoid and a non-convex polynomial 
Let n = 3, 7? = 2, a = 1, f = (-2, -2, 1), c = (-4, -5, 0), r = 2^2 and 



3 11 
14 1 
115 



Using Maxima [16], we can find the following stationary point of 11'^ in 

(A,/2,^) = (0.84101802234162, 1.493808342458642,0.12912817444352). 

To put in evidence that this stationary point is in fact in S^, notice that the 
eigenvalues of A are given by: 



/3i = cos + f ) + 4 « 3.460811127 
^2 = ^ cos + I) + 4 2.324869129 
^3 = ^ cos (f ) + 4 ^ 6.214319743, 



j . Then, the matrices I + AA and (1 + + AA) — I are 

similar to 



3.910604529727413 

2.955256837074665 

6.226354900456345 



and 



3.664931769065526 

2.525304438283014 

6.42737358375643 



respectively. Finally, the global minimizer of (V) is given by Equation (11): 



■ -1.121270493506938 \ 
-0.83025443673537 , z 
0.66262025515374 / 



-4.091279940255224 \ 
-4.009023330835817 
1.807730500535487 / 



3.3. Example given in [19] 

Let n = 2, a = 77 = 1, c = (1,0), f = (^^,0^, r = 1 and A = I. As it was 

pointed out in [19], there are no stationary points in S^. Under the new conditions 
of Theorem 2.3, this is expected since the problem has more than one solution (see 
figure 3). The following was found ([19]) to be one of the global minimizers of {V): 



_ _ f 0.5872184947 \ _ _ ( 1.012757759 A 
^ ~ ^0.8094284647 J ' ^~ V 1.395996491 J 
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Figure 2.: Distance between an ellipsoid and a non-convex polynomial 




Figure 3.: Example given in [19] 



Notice that Sa and are defined as in Equations (20) and (21). 

In order to solve this problem, we will introduce a perturbation. Instead of the 

given f, we will consider f„ = g^i for n > 100. 

The following table summarizes the results for different values of n. 



n 


(Art) Mnj ?n) ^ S'^ 




^71 


(yn,Zn) 




64 


(0.2284381,5.319007,-0.0219068) 


y = 


/ 0.2250312 \ 
^0.9743515 ) 


, z = 1 


' 0.2764370 \ 
J. 1969306 ) 


1000 


(0.6926569,16.01863,-0.0248297) 


y = 


f 0.5656039 \ 
V 0.8246770 / 


, z = 1 


' 0.9573734 \ 
J.3958953 ) 


10000 


(0.7214940,16.42599,-0.0254434) 


y = 


/ 0.5850814 \ 
^0.8109745 ) 


, z = 1 


' 1.0072142 \ 
^ 1.3960878 ) 


100000 


(0.7243521,16.46345,-0.0255083) 


y = 


f 0.5870050 \ 
^0.8095833 / 


, z = 1 


' 1.0122034 \ 
^ 1.3960066 ) 



Remark 1 : The combination of the linear perturbation method and canonical 
duality theory for solving nonconvex optimization problems was first proposed 
in [18] with successful applications in solving some NP-complete problems [20]. 
High-order perturbation methods for solving integer programming problems were 
discussed in [8]. 
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Figure 4.: Perturbations of Example given in [19], n = 64 to the left and n = 100000 
to the right. 

4. Concluding remarks and future research 

• The total complementary function (Equation (8)) is indeed useful for find- 
ing necessary conditions for solving {V) by means of the Canonical Duality 
theory. 

• The examples presented in [19] do not contradict the new conditions and 
results presented here. 

• As stated by Theorem 2.3, in order to use the canonical dual transformation 
a necessary condition is that {V) has a unique solution. The question if this 
condition is sufficient remains open. 

• The combination of the perturbation and the canonical duality theory is 
an important method for solving nonconvex optimization problems which 
have more than one global optimal solution. 

• Finding a stationary point of 11'^ in 5^ is not a simple task. It is worth to 
continue studying this problem in order to develop an efficient algorithm 
for solving challenging problems in global optimization. 
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